AD-A212  635 


'  REPORT  DOCUMENTATION  PAGE 


m  NUMBER  _ 


4  T|Tl.  t*  {mat  Subtitle)  .  ~ 

A  luality  Assurance  Model  of  operation  Moriai.it' 
in.  Coronary  Artery  Surgery 


■ 

I 


AU  ~»OR(f) 

Edvards  FH,  Albus  RA,  Zaitchuk  R,  Craober  G 
an i Barrv  M. _ 


■ 


k!-  AI)  INSTRUCTIONS  V 

l>KI  (  i.|  COMI'l.KTiNd  I-UKM  ^ 


to-'V-'u  s  o*,  i.  a  r  H'juntii  *« 


;  '  v»*r  or  report  a  period  cove  re 


S.  =r.PFORniNO  ORG.  RCF-ORT  NUMBER 


a.  CONTRACT  OR  GRANT  NUMBERf«; 


.  NUMBER  OF  PAGES 


a ii  i :  pa  l  tv  el . _ 

PERFORMING  ORGANIZATION  NAME  AND  AOURESS  PROGRAM  tLEMEN  T.  PROJECT,  TASK 

,  -  AREA  ,1  WORK  UNIT  NUMBERS 

Division  of  Surgery 

Waiter  Reed  Army  Institute  of  Research 
Wa -bin- ton,  D.C.  20307-5100 

!.  COST ROLL1N G  OFFICE  NAME  ANO  ADDRESS 

US  Army  Research  and  Development  Command 
Fort  Dctrick,  Frederick,  ID  27101  l3'  dumber  of  pages 

a 

47  MONITORING  AGENCY  NAME  ft  AOORESSfK  dlUatarM  from  ControlUnj Ottlc*)  SECURITY  CLA 5 S .  (o f  tht •  r epc  7)  “™ 

Wal ter  Reed  Army  Institute  of  Research 

Washington,  DC  20307-5100  •  _  _ 

IS*,  declassification  /  down  g  \oing 
SCHEDULE 

i<r  DISTRIBUTION  STATEMENT  (ot  thin  Ftoport; 

Approved  for  public  release,  distribution  unlimited 


>7.  DISTRIBUTION  STATEMENT  (ol  the  abstract  ontarod  In  Block  70.  It  different  from  Scpr>rt) 


’0  SUPPLEMENTARY  NOTES 


ELECTE 
SEP  20  1989 


'  ^  KEY  WQROS  (Cont  i9  on  reverse  side  tl  nacaa  tary  and  Identity  by  block  number) 

BEST 

AVAILABLE  COPY 


ABSTRACT  fOroff  /•  mx  rarer ea  si  da  ft  nacaa*  ary  and  Identify  by  thick  number) 

'"\0uality  ssurancu  r.-i-..n.-n-v  .■ii-titv  hvp.-i-:-:  gr-iitire  i  C.MU 
'  •'.'r^arison  of  opera  t  i  .a  mturtal  ity  ag.i  i  -i  ■  :  <v!  st:: 

: .  •  :rSySta:.iFt  ics  r  ro  '.uynccopUibi  e  in  •  i-  ijsS*me:-’  ,  and 
Howevoi  ,  Jr\ i r.  pr'inc.ijilo  hi.,  not  h.  ■  ;  ■ 

:i  ;  r  epo  rt?!>-  i\u*r  r  hi  til  lit  v.is  »•  s .  ■  *  ■  I 


-C  1473 

fcPmrjN  Oi 

j .  A  AS  r.  olivji  «  1 1 

".»*  "  r«  ^  ,  i  ti 

:  V  !*“  m  r  V- 1  1  i  t  • » f » r 

■  if  Tn vi  n  <»i  -'Vn 


ORIGINAL  ARTICLES 


A  Quality  Assurance  Model  of  Operative  Mortality 
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Geoffrey  M.  Graeber,  MD,  and  Michael  Barrv,  MD 
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Research,  Washington,  DC;  and  F.  Eduard  Hebert  School  of  Medicine,  Uniformed  Services  University  of  Health  Sciences, 
Bethesda,  Maryland 


Quality  assurance  in  coronary  artery  bypass  grafting 
(CABG)  surgery  requires  a  comparison  of  operative  mor¬ 
tality  against  an  accepted  standard  of  care.  Raw  mortality 
statistics  are  unacceptable  in  this  context,  and  risk  factor 
analysis  is  essential.  However,  this  principle  has  not 
been  adequately  demonstrated  in  previous  reports.  Our 
goal  in  this  study  was  to  develop  a  risk  model  of  accepted 
CABG  mortality  and  illustrate  its  proper  use  in  coronary 
artery  surgery.  The  model  was  derived  from  a  Bayesian 
analysis  of  6,630  patients  undergoing  CABG  in  the  Cor¬ 
onary  Artery  Surgery  Study  (CASS)  registry.  Age,  sex, 
ventricular  function,  previous  myocardial  infarction,  ex¬ 
tent  of  coronary  artery  disease,  unstable  angina,  and 


^  surgical  priority  were  used  by  the  model  to  sort  patients 
'  into  risk  categories,  from  January  1984  through  Decem¬ 
ber  1987,  840  patients  underwent  isolated  CABG  at  our 
hospital.  With  raw  mortality  data,  the  3.9%  (33/840) 
mortality  of  our  patients  was  significantly  different  from 
the  2.3%  (153/6,630)  CASS  mortality  ( p  <  0.001).  When 
our  patients  were  entered  into  the  CASS  model  for  risk 
stratification,  however,  our  CABG  mortality  conformed 
to  the  CASS  experience-.  These  results  illustrate  the 
fallacy  of  using  raw  mortality  statistics  for  interinstitu- 
tional  comparisons.  This  type  of  risk  model  is  a  funda¬ 
mental  element  of  CABG  quality  assurance. 

(Ann  Thome  Surg  1989;47:646-9) 


An  effective  quality  assurance  program  compares  op¬ 
erative  results  against  accepted  standards  of  care. 
However,  it  is  quite  difficult  to  applv  this  principle  to  the 
field  of  coronary  artery  surgery  [1~4|.  The  major  obstacle 
has  been  the  need  to  account  for  all  important  risk  factors 
so  that  patients  can  be  sorted  into  appropriate  risk  cate¬ 
gories  [1,  3-5).  Certainly  the  use  of  raw  statistical  data 
without  allowing  for  risk  stratification  is  a  disservice  to 
patient  and  physician  alike  [4-6].  It  should  be  possible  to 
use  a  model  of  accepted  operative  mortality  to  compare 
the  predicted  results  of  the  model  against  the  observed 
results  of  patients  in  similar  risk  categories. 

We  have  investigated  this  approach  by  developing  a 
Bayesian  model  of  the  Coronary  Artery  Surgery  Study 
(CASS)  experience  for  comparison  against  our  own  oper¬ 
atic  a  experience.  The  model  has  been  derived  with  par¬ 
ticular  attention  to  ensure  that  patients  are  closely 
matched  and  stratified  according  to  preoperative  risk 
factors. 

Risk  stratification  is  an  essential  element  of  quality 
assurance  [1,  2,  4-7],  The  CASS  group  developed  a 
logistic  risk  equation  [8]  to  address  this  issue,  but  its 
cumbersome  nature  has  precluded  practical  application 
[1).  More  recently,  we  [4]  have  used  a  Bayesian  algorithm 
to  sort  patients  into  major  risk  categories.  Our  success  in 
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using  this  method  to  model  our  own  operative  experience 
encouraged  us  to  use  a  similar  system  to  represent  the 
CASS  results.  The  technique  is  completely  general  and 
can  be  applied  to  other  clinical  areas. 


Material  and  Methods 

The  Bayesian  mode!  was  developed  according  to  previ¬ 
ously  published  guidelines  [4,  9],  and  was  designed  to 
predict  the  probability  of  death  after  coronary  artery 
bypass  grafting  (CABG)  based  on  the  reported  experience 
of  the  CASS  registry.  There  are  several  studies  detailing 
the  composition  of  CASS  registry  patients,  but  the  most 
complete  for  the  purpose  of  this  study  was  that  of 
Kennedv  and  colleagues  [10)  from  the  Coordinating  Cen¬ 
ter  for  Collaborative  Studies  in  Coronary  Artery  Surgery. 

Two  prognostic  categories  were  considered;  survival 
and  death.  Seven  preoperative  patient  variables  generally 
regarded  as  important  risk  factors  were  selected;  age,  sex, 
ejection  fraction,  extent  of  coronary  artery  disease,  previ¬ 
ous  myocardial  infarction,  unstable  angina,  and  surgical 
priority.  These  risk  factors  were  used  to  determine  the 
conditional  probabilities  associated  with  each  prognostic 
category  (Table  1).  The  resultant  conditional  probability 
matrix  was  then  incorporated  into  a  computerized  Baye¬ 
sian  algorithm  to  serve  as  a  model  of  CASS  operative 
mortality.  For  any  given  patient,  the  model  analyzes  these 
seven  risk  factors  to  generate  a  prediction  of  the  proba¬ 
bility  of  operative  death  for  that  patient  based  on  the 
reported  CASS  experience. 

The  patient  population  for  entry  into  this  model  was 
drawn  from  the  recent  operative  experience  at  Walter 
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Table  1 .  Conditional  Probabilities  From  CASS  Resist nf  h 


Variable 

Survivors 
(n  =  6,477) 

Deaths 
(n  -  153) 

Age  (yr) 

<50 

1,738  (27) 

22(14) 

50-70 

4,530  (70) 

113  (74) 

>70 

209  (3) 

18(12) 

Sex 

Male 

5,464  (84) 

105  (69) 

Female 

1,013  (16) 

48  (31) 

Ejection  fraction  (l"< ) 

>50 

3,839  (78) 

74  (70) 

30-50 

977  (20) 

27  (25) 

<30 

102  (2) 

5  (5/ 

Coronary  arterv  involvement 

Left  main 

976  (15) 

37  (24) 

3  Vessels 

3,198  (50) 

92  (61) 

2  Vessels 

2,018  (31) 

43  (28) 

1  Vessel 

1,196  (19) 

17(11) 

Previous  myocardial  infarction 

3,413  (53) 

84  (55) 

Unstable  angina 

2,652  (41) 

96  (63) 

Surgical  priority 

Routine 

5,129  (80) 

89  (59) 

Urgent 

1,062  (17) 

39  (26) 

Emergent 

189  (3) 

23(15) 

0  The  number  of  patients  in  each  prognostic  category  (survivors  or  deaths) 
that  have  the  designated  risk  factor.  The  percentage  of  patients  is  shown 
in  parentheses.  For  exar.  pie,  of  those  who  survived,  1,738  or  27'*  (1,738/ 
6,477)  were  less  than  50  vears  old.  b  Ejection  fraction  calculations  were 
based  on  a  total  of  5,024  patients,  coronary  artery  involvement  was  based 
on  6,564  patients,  and  surgical  priority  was  based  on  6,531  patients  as 
reported  bv  Kennedy  and  colleagues  (10j.  The  other  calculations  were 
based  on  6,630  patients. 


Reed  Army  Medical  Center.  From  January  1984  to  January 
1988,  895  consecutive  patients  underwent  isolated  CABG 
at  our  hospital.  Insufficient  clinical  information  eliminated 
38  of  them  (none  of  whom  died)  from  the  study.  Seven¬ 
teen  patients  were  taken  to  the  operating  room  with  an 
evolving  myocardial  infarction  and  severe  hemodynamic 
compromise,  thereby  making  them  inappropriate  for 
comparison  with  CASS  patients.  The  remaining  840  pa¬ 
tients  made  up  the  population  evaluated  by  the  CASS 
model  (Table  2). 

Surgical  priority  was  assigned  using  definitions  similar 
to  those  used  by  the  CASS  group  J4,  8,  10).  Emergency 
operations  were  usually  performed  within  one  hour  of 
catheterization  or  clinical  deterioration.  Procedures  were 
classified  as  urgent  if  CABG  was  necessary  within  two 
days  of  catheterization.  All  others  were  considered  elec¬ 
tive. 

Operations  were  performed  using  cardiopulmonary  by¬ 
pass  and  moderate  systemic  hypothermia  with  topical 
cooling.  Cold  potassium  crystalloid  or  blood  cardioplegia 
was  used  in  all  patients.  Venting  was  usually  established 
by  way  of  the  ascending  aorta,  but  this  depended  on  the 
preference  of  the  operating  surgeon.  Distal  coronary 


Table  2.  Characteristics  of  the  840  Patients'1 


Survivors 

Deaths 

Variable 

(n  =  807) 

(n  =  33) 

Age  (yr) 

<50 

180  (22) 

3  (9) 

50-70 

531  (68) 

23  (70) 

>70 

76  (9) 

7  (21) 

Sex 

Male 

693  (86) 

24  (73) 

Female 

114  (14) 

9(27) 

Ejection  fraction  (7  ) 

<30 

34  (4) 

4  (12) 

30-50 

168  (21) 

12  (36) 

>50 

605  (75) 

17  (52) 

Coronary  artery  involvement 

Left  main 

127  06) 

8  (24) 

3  Vessels 

549  (68) 

26  (79) 

2  Vessels 

186  (23) 

7(21) 

1  Vessel 

72  (9) 

0 

Previous  myocardial  infarction 

353  (44) 

15  (45) 

Unstable  angina 

Surgical  priority 

109  (14) 

13  (39) 

Elective 

517  (64) 

14  (42) 

Urgent 

201  (25) 

10  (30) 

Emergency 

89  (11) 

9(27) 

•’  Numbers  in  parentheses  are  percentages 

anastomoses  were  performed 

first,  and  the 

proximal 

anastomoses  wore  performed 

over  a  partial 

occlusion 

clamp  during  the  rewarming  phase. 

The  presence  or  absence  of  the  seven  risk  factors  was 
noted  for  each  of  the  840  patients.  Individual  patient  data 
were  then  entered  into  ihe  CA55  model,  and  a  prediction 
of  the  probability  of  operative  death  was  obtained  for  e^ch 
patient.  This  allowed  the  patients  to  be  grouped  into  risk 
categories,  as  shown  in  Table  3.  The  observed  mortality 
for  each  category  was  obtained  by  tabulating  the  actual 
number  of  deaths  that  occurred  in  that  group.  A  compar- 


Tablc  3.  Predicted  Versus  Observed  Operative  Mortality 
Predicted 


Mortality 

OO 

Observed 
Mortality'1  (7) 

959?  Confidence 
Limitsb 

<5 

2.7  (17/625) 

1.67,-4.491 

3-25 

3.5  (5/139) 

1.37,-8.67, 

25-50 

13.7  (7/51) 

6.17,-26.87, 

>50 

16.0  (4/25) 

5.27,-36.97, 

>75 

40.0  (2/5) 

7.37,-82.97, 

■'  Within  the  parentheses,  the  numerator  is  the  number  of  deaths  and  the 
denominator  is  the  total  number  of  patients  in  that  risk  category.  b  The 
confidence  limits  indicate  that  one  can  be  95*5  certain  that  the  "true" 
observed  mudMitv  will  lk  within  ll.c  specified  interval. 
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ison  of  the  predicted  and  observed  mortality  is  also  shown 
in  Table  3. 

Results 

In  our  population,  33  deaths  occurred  at  some  point 
during  the  hospitalization  for  CABG.  The  overall  mortal- 
itv  for  the  group  of  840  patients  was  3.45  (33  840).  Urgent 
or  emergent  operations  made  up  37' f  (304  840)  of  this 
series  and  accounted  for  585  (14  33)  of  the  deaths.  Fortv- 
three  of  the  840  patients  were  undergoing  reoperative 
CABG.  Additional  clinical  details  ot  the  patient  popula¬ 
tion  are  given  in  Table  2. 

Using  onlv  raw  mortalitv  data,  a  v’  analvsis  showed 
that  the  CASS  mortalitv  of  2.3‘  *  (133  8.630)  is  significantly 
less  than  the  3.95  mortalitv  of  our  series  (/»  <  0.001). 
When  our  patients  are  stratified  according  to  risk,  how¬ 
ever,  the  operative  mortalitv  in  our  series  is  actually  less 
than  what  would  be  anticipated  from  the  CASS  experi¬ 
ence.  As  an  example,  25  patients  were  predicted  to  have 
an  operative  mortalitv  of  more  than  50' T  (see  Table  3). 
Based  on  the  CASS  experience,  at  least  13  of  these 
patients  would  have  been  expected  to  die  after  CABG.  In 
fact,  onlv  4  of  them — or  165 — died,  indicating  that  our 
results  were  in  keeping  with  the  standards  of  the  CASS 
group.  The  same  can  be  said  for  each  of  the  remaining  risk 
categories. 

Comment 

These  results  illustrate  the  fallacy  of  using  raw  mortalitv 
data  to  analyze  operative  results.  A  valid  comparison 
must  account  for  risk  factors  that  permit  stratification  into 
patient  subgroups  that  are  at  different  levels  of  risk  for 
CABG  procedures  [2,  3,  5,  7,  8],  Once  patients  have  been 
sorted  into  such  risk  categories,  then  reasonable  interin- 
stitutional  comparisons  can  be  made. 

It  is  clearly  desirable  to  use  a  mode!  that  analyzes 
individual  patient  risk  factors  to  generate  an  estimate  of 
the  probability  of  operative  death  for  the  given  patient. 
The  model  should  be  able  to  account  for  a  large  number  of 
risk  factors  and  should  be  sufficiently  flexible  to  undergo 
changes  in  its  data  base  as  changes  in  the  patient  popu¬ 
lation  occur  with  time.  Both  logistic  risk  equations  [8|  and 
the  theorem  of  Baves  [4]  satisfv  these  requirements. 
Logistic  equations,  however,  have  been  somewhat  diffi¬ 
cult  to  apply  on  a  practical  basis  (1,  4).  We  believe  that 
Bayesian  algorithms  offer  more  flexibilitv  in  this  clinical 
context,  and  have  chosen  to  develop  our  model  using 
previously  described  Bavesian  techniques  [4,  9).  Certainly 
logistic  regression  models  would  be  acceptable  as  well. 

Regardless  of  the  mathematical  algorithm,  one  must 
select  appro,.  rHfe  risk  factors  for  consideration.  T  here  is 
an  enormous  body  of  information  suggesting  the  most 
important  risk  factors  for  CABG,  but  conclusions  vary 
from  one  report  to  another  [1-4,  7,  8,  10-14).  We  have 
chosen  those  patient  parameters  that  are  generally  re¬ 
garded  as  significant  predictors  of  operative  mortality  [5, 
7,  10,  12,  1 3 1 .  As  we  (4,  9|  have  stated  in  earlier  studies, 
wc  believe  that  a  problem  of  this  complexity  icquiw  the 
analysis  of  a  large  number  of  parameters.  Certainly  reop- 
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oration  should  ideally  be  included  among  the  list  of 
important  risk  factors.  However,  it  is  not  possible  to 
obtain  all  the  information  we  would  like  from  published 
CASS  reports. 

In  deciding  to  use  CASS  for  our  data  base,  we  were 
confronted  with  the  choice  of  using  all  available  data  from 
one  report  or  perhaps  gathering  more  data  from  reports 
published  at  different  times.  However,  because  it  is  nec¬ 
essary  to  base  the  Bavesian  conditional  probabilities  on  a 
single  patient  population,  we  relied  on  a  single  report 
[  10).  The  use  of  information  gathered  from  reports  that 
span  several  years  may  introduce  temporal  variables  that 
would  adversely  affect  the  validity  of  the  model. 

Our  choice  of  CASS  to  represent  a  standard  of  care  was 
completely  arbitrary.  There  are  a  number  of  reasonable 
objections  to  this  choice.  Generally  the  CASS  population 
is  made  up  of  patients  falling  into  the  lower  end  of  the 
CABG  risk  spectrum  [3,  12,  14).  In  addition,  many  of 
these  CASS  patients  underwent  CABG  a  decade  ago  and 
therefore  mav  not  represent  a  true  reflection  of  current 
risks.  We  recognize  that  other  objections  to  the  CASS 
registry  can  be  raised  [  11-13],  but  we  believe  that  CASS  is 
a  reasonable  choice  in  this  clinical  context.  We  would  not 
contend  that  CASS  results  are  the  best  possible,  but  they 
do  reflect  at  ieast  an  acceptable  average  standard  of  care 
[8,  11).  As  mentioned,  the  approach  we  have  used  is 
completely  general,  and  others  may  choose  an  alternative 
to  represent  the  standard. 

The  major  shortcoming  of  this  study  is  that  the  CASS 
model  has  not  been  tested  against  CASS  registry  patients 
to  confirm  its  validity.  Statistical  theory  dictates  that  ihe 
Bayesian  model  will  provide  an  accurate  portrayal  of  the 
CASS  experience,  but  without  direct  access  to  that  regis¬ 
try,  that  cannot  be  verified.  Perhaps  such  information 
from  this  government-funded  study  can  be  made  avail¬ 
able  in  the  future  so  that  the  development  of  operative 
risk  models  can  be  facilitated. 

It  should  be  emphasized  that  no  attempt  has  been  made 
here  to  identify  the  most  important  risk  factors.  That  is  the 
task  of  variate  analysis,  which  has  been  described  in  great 
detail  in  numerous  other  publications.  The  purpose  of  the 
Bayesian  algorithn  u  use  preoperative  patient  risk 
factors  to  generate  ■  ’iction  of  the  probability  of 
operative  death  for  a  ,le  given  patient.  Although  it 
mav  be  important  to  recognize  the  most  important  risk 
factors  derived  from  large  patient  surveys,  that  informa¬ 
tion  has  little  relevance  to  the  single  patient  who  is  seen 
with  a  mvriad  of  clinical  characteristics  that  are  not 
specifically  addressed  in  these  large  trials.  One  must  be 
able  to  predict  the  risk  to  that  individual  patient. 

The  algorithm  presented  here  allows  the  surgeon  to  do 
exactly  that.  One  enters  the  preoperative  risk  factors  of 
the  patient  into  the  computer  program,  and  the  program 
uses  a  Bavesian  formula  to  estimate  the  probability  of 
operative  death  based  on  the  data  base  of  previous  clinical 
experience. 

In  recent  years,  CABG  operative  mortality  has  come 
under  close  investigation.  As  responsible  surgeons  we 
welcome  that  scrutiny,  but  we  must  insist  that  standards 
uf  c.  mparirsr.  fu"y  ''■count  for  the  preoperative  risk 
factors  associated  with  CABG.  The  use  in  1986  of  raw 
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mortality  statistics  bv  the  Department  of  Health  and 
Human  Services  Health  Care  Financing  Administration 
illustrates  the  misconceptions  that  can  arise  from  inappro¬ 
priate  application  of  unsorted  patient  data  |5.  15|.  Hie 
Societv  of  Thoracic  Surgeons  [3|  has  responded  with  a 
statement  of  concern  expressing  serious  reservations 
about  the  use  of  Health  Care  Financing  Administration 
data  to  suggest  a  "quality  of  care”  standard.  If  we  con¬ 
demn  this  simplistic  application  of  mortality  data,  though, 
we  are  obligated  to  propose  -1  more  acceptable  alternative. 
The  statement  of  concern  emphasizes  that  risk  factors 
predictive  of  operative  mortalitv  must  be  identified  and 
subjected  to  appropriate  statistical  analysis  before  com¬ 
parisons  of  mortalitv  rates  between  institutions  can  be 
made.  It  further  encourages  the  development  of  statistical 
models  to  sort  patients  into  risk  categories. 

In  this  study,  we  have  presented  such  a  model  of 
operative  risk.  Although  this  model  mav  not  be  ideal,  it 
does  provide  an  improved  instrument  of  qualitv  assur¬ 
ance  that  is  based  on  sound  principles  of  surgical  risk 
assessment.  Techniques  of  this  kind  mav  encourage  other 
institutions  to  critically  review  their  operative  results  by 
making  valid  comparisons  against  a  selected  standard. 
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